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CLIMBING DOWN GAUSSIAN PEAKS 

By Robert J. Adler*’* and Gennady Samorodnitsky*’* 

How likely is tlie high level of a continuous Gaussian random 
field on an Euclidean space to have a “hoie” of a certain dimension 
and depth? Questions of this type are difficult, but in this paper we 
make progress on questions shedding new light in existence of holes. 
How likely is the field to be above a high level on one compact set 
(e.g. a sphere) and to be below a fraction of that level on some other 
compact set, e.g. at the center of the corresponding ball? How likely 
is the field to be below that fraction of the level anywhere inside the 
ball? We work on the level of large deviations. 


1. Introduction. Let T be a compact subset of W 1 . For a real-valued 
sample continuous random field X = (X(t), t 6 T) and a level u, the excur- 
sion set of X above the level u is the random set 

(1.1) A u = {t e T : X(t) > u } . 

Assuming that the entire index set T has no interesting topological features 
(i.e., T is homotopic to a ball), what is the structure of the excursion set? 
This is a generally difficult and important question, and it constitutes an 
active research area. See Adler and Taylor (2007) and Azais and Wschebor 
(2009) for in-depth discussions. In this paper we consider the case when the 
random field X is Gaussian. Even in this case the problem is stiil difficult. 

In a previous paper Adler et ai. (2014) we studied a certain connectedness 
property of the excursion set A u for high level u. Specihcally, given two 
distinct points in R rf , say, a and b, we studied the asymptotic behaviour, as 
u — > oo, of the conditional probability that, given X(a) > u and X(b) > u, 
there exists a path £ between a and b such that X(t) > u for every t 

In contrast, in this paper our goal is to study the probability that the 
excursion set A u has holes of a certain size over which the random field 
drops a fraction of the level u. We start with some examples of the types 

‘Research supported in part by US-Israel Binational Science Foundation, 2008262 

tResearch supported in part by ARO grant W911NF-12-10385 and NSF grant DMS- 
1005903 at Cornell University. 

* Research supported in part by URSAT, ERG Advanced Grant 320422. 

AMS 2000 subject classifications: Primary 60G15, 60F10; Secondary 60G60, 60G70, 
60G17. 

Keywords and phrases: Gaussian process, excursion set, large deviations, exceedence 
probabilities, topology. 


1 



2 


ADLER AND SAMORODNITSKY 


of probabilities we will look at. We will use the following notation. For an 
Euclidean ball B will denote by cb its center and by Sb = d(B) the sphere 
forming its boundary. Consider the following probabilities. For 0 < r < 1 
denote 

(1.2) 'k sp (n;r) = P (there exists a ball B entirely in T 

such that X(t) > u for all t 6 Sb but X(s) < ru for some s € B) 

and 

(1.3) x k sp;c (n; r) = P (there exists a ball B entirely in T 

such that X(t) > u for all t G Sb but X(cb) < ru) . 

Simple arguments involving continuity show that the relevant sets in both 
(1.2) and (1.3) are measurable. Therefore, the probabilities ^ sp (u',r) and 
\k sp;c (rt; r) are well defined. These are the probabilities of events that, for 
some ball, the boundary of the ball belongs to the excursion set A u , but the 
excursion set has a hoie somewhere inside the ball in one case, containing 
the center of the ball in another case, in which the value of the field drops 
below tu. 

We study the logarithmic behaviour of probabilities of this type by using 
the large deviation approach. We start with a setup somewhat more general 
than that described above. Specifically, let C be a collection of ordered pairs 
(K\, K 2 ) of nonempty compact subsets of T. We denote, for 0 < r < 1, 

(1.4) 'Pc(?i; r) = P ( there is (K\, K 2 ) G C such that 

X (t) > u for each t G K\ and X(t) < ru for each t G K 2 .) 

We note that the probabilities ^^(rtjr) and 'k sp;c (u; r) are special cases 
of the probability 4 / c(n;r) with the collections C being, respectively, 

C = |(S(b,s), B a ball entirely in T and s G -Bj 

and 

C = |(S'^,cb), B a ball entirely in T j . 

In Section 2 we first introduce the necessary technical background, and 
then prove a large deviation result in the space of continuous functions for the 
probability 4'c(n;r). This result establishes a connection of the asymptotic 
behaviour of the probability \kc(u;r) to a certain optimization problem. 
The dual formulation of this problem involves optimization over a family 
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of probability measures, and in Section 3 we describe important properties 
of the measures that are optimal for the dual problem. The general theory 
developed in these two sections leads to particularly transparent and intuitive 
results when applied to isotropic Gaussian fields. This is explored in Section 
4. 


2. A large deviations result. Consider a real-valued centered contin- 
uous Gaussian random field indexed by a compact subset T C M d , X = 
(X(t), t G T). We denote the covariance function of X by Rrx_(s,t) = 
cov(X(s), A(t)). We view X as a Gaussian random element in the space 
C(T) of continuous functions on T, equipped with the supremum norm, 
whose law is a Gaussian probability measure /ix on C{T). See e.g. van der 
Vaart and van Zanten (2008) about this change of the viewpoint, and for 
more information on the subsequent discussion. 

The reproducing kernel Hilbert space (henceforth RKHS) "H of the Gaus¬ 
sian measure px (or of the random field X) is a subspace of C(T) obtained 
as follows. We identify 7~L with the closure C in the mean square norm of the 
space of finite linear combinations a jX(tj) of the values of the process, 

cij G M, t j G T for j = 1,..., k, k = 1, 2,... via the injection C -A C(T) 
given by 

(2.5) Hw H = (E(X(t)H), t G r) . 

We denote by (•, ■)% and || • ||% the inner product and the norm in the RKHS 
'H. By definition, 

(2.6) \\wh\\ 2 h = E(H 2 ). 

The “reproducing property” of the space T-L is a consequence of the fol- 
lowing observations. For every t G M d , the fixed t covariance function Rt = 
R(-, t) is in %. Therefore, for every wh G %, and t G R rf , wjj{ t) = {wjj, Rt)n- 
In particular, the coordinate projections are continuous operations on the 
RKHS. 

The quadruple (C(T),R, w, /ix) is a Wiener quadruple in the sense of Sec¬ 
tion 3.4 in Deuschel and Stroock (1989). This allows one to use the machinery 
of large deviations for Gaussian measures described there. 

The following result is a straightforward application of the general large 
deviations machinery. 

THEOREM 2.1. Let X = (X(t), t G T) be a continuous Gaussian ran¬ 
dom field on a compact set T C M d . Let C be a collection of ordered pairs 
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(K], K r 2 ) of nonempty compact subsets ofW. d , compact in the product Haus- 
dorff distance. Then for 0 < r < 1, 

(2.7) — - liin Dc (t) < liminf —^ log r) 

2 rtr u-»oo 


< limsup log ^c(«; r) < -^L> c (r), 

where for r > 0, 

(2.8) Dc(r ) = inf j/?// 2 : H G £, and, for some ( K\,I \2 ) G C, 


E(X(t)H} > 1 for each t G Iii and E(X(t)H^ < r for each t G iD)} • 

Proof. As is usual in large deviations arguments, we write, for u > 0, 

m c (u-r) = P(u~ l X G A) , 
where A is the open subset of C(T) given by 

A = |cj G C{T ) : there is (K\ , Ä^) G C such that 

w(t) > 1 for each t G K\ and w(t) < r for each t G 1 . 

We use Theorem 3.4.5 in Deuschel and Stroock (1989). We have 
(2.9) | 

— inf I(uj) < liminf —r log Ü/Ait; r) < limsuplog ^(u; r) < — inf/(te) . 

CJG-A U—^OO fl u — yQQ U cjG A 

By Theorem 3.4.12 of Deuschel and Stroock (1989) the rate function / can 
be written as 


( 2 . 10 ) 


I(u) = 


__ j jlMlw if w G %, 


oo if ta ^ 77, 


for uj G C(T). Since C is compact in the product Hausdorff distance, 
Ä C |tc G C{T ) : there is (K\ , K 2 ) G C such that 

w(t) > 1 for each t G /li and w(t) < r for each t G 
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and so (2.9) already contains the upper limit statement in (2.7). Further, for 
any 0 < e < 1, 

inf I(lu) < inf { EH 2 : H £ £, and, for some (K\,Ko) £ C, 


ojh{ t) > 1 + £ for each t £ K i and u>h{ t) < (1 — e)r for each t £ ll 2 } 

= ( i +e ) 2jDc (rrl r ) • 

Letting e {. 0 establishes the lower limit statement in (2.7). □ 

The lower bound in (2.7) can be strictly smaller than the upper bound, as 
the following example shows. We will see in the sequel that in certain cases 
of interest the two bounds do coincide. 


Example 2.2. Let T = {0,1,2}. Starting with independent standard 
normal random variables Y\ , I 2 we define, for 0 < ro < 1 and a > ro, 

X(0) = Y u X(l) = r 0 Y u X(2) = oY x + T 2 • 

Note that in this case C = {ail} + 02 I 2 , ai £ M, a 2 £ M}. 

Let C = {({0}, {1}), ({0},{2})}. It is elementary to check that 

Tf ( r \ = j 1 + (°-r ) 2 for 0 < r < r 0 , 
c{ ’ \ 1 for r > r 0 , 

and that this function is not left continuous at r = tq. 


For a fixed pair {K\, i£ 2 ) £ C denote 

(2.11) Dk u k 2 ( r ) = inf {EH 2 : H £ C such that 

E(X(t)H{ > 1 for each t £ K\ and E{X(t)H{ < r for each t £ i£ 2 | . 
Clearly, 

(2.12) E) c (r)= min D K 1<2 (r), 

(K u K 2 )eC 

with the minimum actually achieved. Furthermore, an application of Theo- 
rem 2.1 to the case of C consisting of a single ordered pair of sets immediately 
shows that 

- - lim D k I<2 ( r ) < lirn inf log ^ Ki ,k 2 (u; r ) 

2 rfr U—>00 U z 
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(2.13) 

where 


< lim sup -g log ^k u k 2 (u; r) < --D Ku k 2 (r), 

w—>• oo U ^ 


^K 1 ,K 2 (, u 'i r ) = P ( -X”(t) > u for all t € K\ and X(t) < ru for all t € K 2 .) 

The next result describes useful properties of the function Dk 1 ,k 2 - 

Theorem 2.3. (a) If the feasible set in (2.11) is not empty, then the 

infimum is achieved, at a unique H £ C. 

(b) The following holds true: 


(2.14) D KuK2 (r) = < min 


mm 
r+( 


mm 


MeM?(K 1) J Kl J Kl 

M2) 


-Rx(ti,t 2 ) Hi(dti)fj, l (dt 2 ), 


M eM+(ji: 1 ), W 6 M 1 +(jf 2 ) B Kl! K 2 (ni, r) 

subject to (2.15) 


with 


Aki,k 2 {iii, 1 * 2 ) — 


Ilu JIu 


Äx(ti,t 2 )/xi(dti)/xi(dt 2 ) 


n< 2 J k 2 


-Rx(ti, t 2 ) H2(dt 1 )n 2 (dt 2 ) 


I Ki J K 2 


Rx(ti,t 2 ) m(dti)n 2 (dt 2 ) 


B Kl ,K 2 (lii, V2; r) = 

[ [ Rx(ti,t 2 ) m(dti)m(dt 2 ) - 2 r [ f Äx(ti,t 2 )/xi(dti)/x 2 (dt 2 ) 

J Kl J Kl J Kl J Ko 


+ 


IK 1 J K 2 
Äx(ti,t 2 )// 2 (dti)/x 2 (dt 2 ), 


j k 2 j i< 2 

and the condition in the minimization problem is 
(2.15) 

[ [ R-x.(ti,t2)fJ,i(dti)n 2 (dt 2 ) >r [ f -R x (ti,t 2 ) m(dti)fj,i(dt 2 ). 

J Kl J K 2 J Kl J Kl 
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Proof. For part (a), let (H n ) C C be a sequence of elements satisfying 
the constraints in (2.11) such that EH 2 —> Dx u k 2 (r) as n oo. By the Ba- 
nach - Alaoglu theorem (see e.g. Theorem 2, p. 424 in Dunford and Schwartz 
(1988)), the sequence (H n ) is weakly relatively compact in C, and so there 
is H & C and a subsequence oo such that E(H nk Y ) — > E(HY) as 

k —> oo for each Y G C. Further, EH 2 < liminf^oo EH 2 k = -D/y ,k 2 ( r )- 
Therefore, H is an optimal solution to the problem (2.11). The uniqueness 
of H follows from the convexity of the norm. 

For part (b) we will use the Lagrange duality approach of Section 8.6 in 
Luenberger (1969). Let Z = C(K\) X C(K 2 ), which we equip with the norm 
||(^i, <^2)||z = max(||^i|| C ( Kl ), \\ip2\\c(K 2 ))- Consider the closed convex cone 
in Z defined by P = {(<£> 1 ,^ 2 ) : <Pi(t) > 0 for all t £ Kj, i = 1,2}. Its dual 
cone, which is a subset of Z*, can be identified with M + (K\) X M + (K 2 ), 
under the action 


(/r 1,M 2 )((^1,V ? 2 )) = / (pidm+ / (f2dfi 2 

J K l Jk 2 

for a finite measure /j,; on Ki , i = 1,2. Define a convex mapping G : £ —> Z 
by 

G(iL) = ((l - Wtf(t), t G iL|), (lü^(t) - r,t£ # 2 )). 

We can write 

(2.16) {D Kl ,K 2 (r )) 1/2 = inf [(EH 2 ) 1 / 2 : H <E £, G(H) € - p } . 

We start with the assumption that the feasible set in (2.11) and (2.16) 
is not empty. Let z > r, and consider the optimization problems (2.11) and 
(2.16) for Dk\.k ž (z). The feasible set in these problems has now an interior 
point, and in this case Theorem 1 (p. 224) in Luenberger (1969) applies. We 
conclude that 


(2.17) 


(£ ) Ki,k 2 (^)) 1/2 


max inf 

MiGM+ (Ki), /i 2 eM + (k 2 ) H&c 


(EH 2 ) 1 / 2 


+ [ (l - w H (t)) Hi(dt) + [ (w H (t) - z) fj, 2 (dt) , 

J Kl JK 2 

and the “max” notation is legitimate, because the maximum is, in fact, 
achieved. For i = 1,2 and /.q G M + (K t ) denote by ||//j|| its total mass, 
and by /q G (Ki) the normalized measure /q = jiq/||/q|| (if ||/q|| = 0, we 
use for (lj an arbitrary fixed probability measure in M + (Kj)). Then 


{D Ku k 2 (z )) 1/2 


max 

fi 1 eM+(K 1 ),fi 2 eM+(K 2 ) 


iiw 


*110211 
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+ inf 
Hee 


{EH 2 ) 11 ' 2 - \\m\l [ w H (t) p,i(dt)+ \\n 2 \\ [ w H {t)fi 2 {dt) 
J Kl JAA 


IK i JAA 

Note that for fixed /i* £ M + {Ki ), i = 1, 2 we have 


inf 

i/e£ 


(^Tir 2 ) 1 / 2 — H/Uill ( w H (t)fii(dt) + \\/j, 2 \\ f w H (t)p, 2 (dt) 

J Ki J K 2 

= inf a<^ 1 - sup ||M / itfff(t) £i(dt) - ||M / w H {t) fa{dt) 
°A° l HeC,EH 2 =1 L J Ki JK 2 

_ | 0 if SUp^ e £ )E jy2 =1 [. . .] < 1 

l -oo if sup HeC EH 2 =1 [.. .} > 1 

Therefore, 

(D Ki ,k 2 {z))^ 2 = m ax Atie M+ ( A l) , At2 eM+ ( A 2 ) (HM --HM) 

subjeet to 


sup 
HeC,EH 2 = l L 


d|| / w^(t)/ti(dt) - ||/x 2 || / UY/(t)A2(dt) 
JAA JAA 


< 1. 


Note that by the reprodueing property, for fixed € M + (K 1 ), ^2 £ M + {K 2 ), 


sup 

HeC,EH 2 = 1 


sup 

wGH, ||ui||-h = 1 


IMI / u>ff(t)/ii(dt) 

JAA 


/AA 


w H (t) fcidt) 


w, HMI / Rt(-)fii(dt) - ||MI / Ä, 

JAA ■) J<2 


'*(■) fc(dt)) 


/ "H 


Assuming that the element in the seeond position in the inner produet is 
nonzero, the supremum is achieved at that element scaled to have a unit 
norm. Therefore, value of the supremum is 


IM / MO £i(M - HM / Rt{-)h(dt) 

J Ki J AA 


•H 


which is also trivially the case if the element in the seeond position in the 
inner produet is the zero element. In any case, using the definition of the 
norm in "H, we conclude that 


{Dk u k 2 {z)) 1/2 


max max {mi — z m 2 ) 

mi >0, m 2 >0 fj! gM+ {Kl ), M 2 SM+ (AA) 
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(2.18) 


subject to 


m 


2 

1 




-Rx(ti,t 2 ) ni(dti)ni(dt 2 )- 2 mim 2 




-Rx( ti, t 2 ) Hi(dt 1 )/j 2 (dt 2 ) 


+m 2 2 f [ Rx(ti,t 2 ) H2(dti)/j, 2 (dt 2 ) < 1. 

J k 2 J k 2 

Next, we show that (2.18) holds for z = r as well. Let A(z), z > r be 
the value of the maximum in the right händ side of (2.18). We know that 
Dri,k 2 (z ) = A(z) 2 for z > r. Moreover, it is clear that A(z) f A(r) as z \,r. 
Therefore, in order to extend (2.18) to z = r it is enough to prove that 


(2.19) lim D KltK2 (z) = D Ku k 2 (r). 

z\.r 

To this end, choose a sequence z n j. r. For n > 1 there is, by part (a), the 
optimal solution H n of the problem (2.11) corresponding to z n . Appealing to 
the Banach-Alaoglu theorem, we see that the sequence ( H n ) is weakly rela- 
tively compact in £, and so there is H £ C to which it converges weakly along 
a subsequence. This H is, clearly, feasible in (2.11) for z = r. Furthermore, 
EH 2 < lim n _ ? . 0O Dr 1 ^k 2 (z n ), implying that D KuK2 (r) < lim z ± r D KljK2 (z), 
thus giving us the only nontrivial inequality in (2.19). Therefore, (2.18) holds 
for z = r. 

A part of the optimization problem in (2.18) with z = r has the form 

max (mi—rm 2 ) 

mi >0, m2>0 


(2.20) subject to 

am\ — 2bmim 2 + cm 2 < 1 

for fixed numbers a > 0, c > 0 and b £ M. In our case, 

a= / / -Rx(ti,t 2 )/xi(dti)/xi(dt 2 ), b = / / Ä x (ti, t 2 ) Hi{dti) n 2 (dt 2 ) 

J K, J K\ J Ki JK 2 

and 


(2.21) c — f f iž x (ti, t 2 ) fj, 2 (dti)fj, 2 (dt 2 ). 

J k 2 J k 2 


These specihc numbers satisfy the condition 

(2.22) b 2 <ac, 
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and we will assume that this condition holds in the problem (2.20) we will 
presently consider. 

As a first step, it is clear that replacing the inequality constraint in this 
problem by the equality constraint 


— 2 bm,\m 2 + cm| = 1 


does not change the value of the maximum, so we may work with the equal¬ 
ity constraint instead. The resulting problem can be easily solved, e.g. by 
checking the boundary values m\ = 0 or rri 2 = 0, and using the Lagrange 
multipliers if both rn\ > 0 and rri 2 > 0. The resulting value of the maximum 
in this problem is 


(2.23) 


a 1 / 2 if b < ra 

(GŽS# 15 ) 1/2 if b>ra 


Moreover, it is elementary to check that we always have 

/ c + r 2 a — 2 rb\ 11,2 1 

\ ac — b 2 J ~ a 1 / 2 

Substituting (2.23) into (2.18) with z = r and using the values of a, b, c given 
in (2.22) gives us the representation (2.14). 

It remains to consider the case when the feasible set in (2.11) and (2.16) 
is empty. In this case Dx t ,k 2 ( r ) = oo, so we need to prove that the optimal 
value in the dual problem (2.18) (with nrax replaced by sup in the statement) 
is inhnite as well. For this purpose we use the idea of subconsistency in 
Section 3 of Anderson (1983). We write the minimization problem (2.11) as 
a linear program with conic constraints, called IP in that paper, with the 
following parameters. The space X = R x C is in duality with the itself, 
Y = X. The space Z = C{K\) x C{K 2 ) (as above) is in duality with the 
space W = M(K±) X M(Ä 2 ), the product of the appropriate spaces of hnite 
signed measures. The vector c € Y has the unity as its M element, and the 
zero function as its C element. The function A : X —> Z is given by 

A(a,H) = [{E{HX{ t), t G K\), (E(HX( t)), t G Äd)), a G R, H G C . 

The vector b G Z is given by a pair of continuous functions, the first one 
takes the constant value of 1 over K\. while the second one takes the constant 
value of r over K- 2 - The positive cone Q in Z is dehned by Q = C^(K \) x 
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(—C+(K 2 )), where C+ (K t ) is the subset of C(Ki ) consisting of nonnegative 
functions, i = 1,2. Finally, the positive cone P in X is defined by 

P = {( a,H) : a > {EH 2 ) 1 / 2 } . 

It is elementary to verify that the dual problem IP* of Anderson (1983) 
coincides with the maximization problem (2.18). 

Note that the dual problem is consistent (has a feasible solution). By 
Theorem 3 in Section 3 of Anderson (1983) (see a discussion at the end of 
that section), in order to prove that the optimal value of the dual problem 
is inhnite, we need to ruie out the possibility that the original (primal) 
problem is subconsistent with a hnite subvalue. With a view of obtaining 
a contradiction, assume the subconsistency with a hnite subvalue of the 
primal problem. Then there are sequences (x n ) C P and (z n ) C Q such that 
Ax n — z n —> b as n —> oo and the sequence of evaluations (c, x n ) is bounded 
from above. With the present parameters, this means that there is a sequence 
( H n ) C C with the bounded sequence (EH 2 ) of the second moments and 
two sequences of functions (tpi,n) C C+(Ki), i = 1,2, such that, weakly, 

(E(H n X(t)) - ip ltn (t), t G Ki) -> (1, t G Ki) , 

(E(H n X{ t)) + <p 2 , n (t), t G Ii 2 ) -+{r, t G K 2 ) 

as n —> oo, with the obvious notation for constant functions. Appealing, 
once again, to the Banach-Alaoglu theorem, we hnd that there is H E C 
such that, along a subsequence, H n — > H weakly. Since weak convergence 
implies pointwise convergence, we innnediately conclude that E(X(t)H) > 1 
for each t G K\ and E(X(t)H) < r for each t G K 2 , contradicting the 
assumption that the feasible set (2.11) is empty. The obtained contradiction 
completes the proof. □ 

Remark 2.4. It is an easy calculation to verify that, in the optimization 
problem (2.20), the optimal solution (mi,m 2 ) has the following properties. 
In the case b < ra in (2.23) one has rn 2 = 0, whereas if b > ra in (2.23), 
then the numbers m\ and rn 2 are both positive, and 

mi rb — c 
m 2 ra — b 

We will hnd these properties useful in the sequel. 

REMARK 2.5. We saw in Example 2.2 that the function Dq does not, in 
general, need to be continuous. However, the arguments used in the proof 
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of Theorem 2.3, together with the compactness in the product Hausdorff 
distance of the set C, show that this function is always right continuous 
For a fixed pair (K\, _ff 2 ) E C even the absence of left continuity for the 
function Dk 1 ,k 2 is, in a sense, an exception and not the ruie. Left continuity 
is trivially true at any ro for which the minimization problem (2.11) is infea- 
sible. If that problem is feasible, and it remains feasible for some r < ?’o, then 
the left continuity at ro stiil holds. To see this, suppose r n f ro as n —> oo is 
such that for some 0 < e < oo 

(2.24) lim (D Kl ,K 2 (r n )) 1/2 = (D Kl ,K 2 (ro)) 1/2 + £■ 

n—> oo x 7 7 

Let H n be optimal in (2.11) for r n , n > 1, and H be optimal for ro- Define 
H n = (H n + H)/ 2. Then, for some sequence k n —> oo, H n is feasible in (2.11) 
for r kn , and 

(EHl ) 1/2 < ( (EHl) 1/2 + {EH 2 ) 1/2 ) /2 . 

Letting n A oo we obtain 

limsup {EH 2 ) 1/2 < {D KuK2 (r 0 )) 1/2 + e/2, 

n—>oo 

which contradicts (2.24). Hence the left continuity at ro- 

Left continuity fails at a point ro at which the minimization problem 
(2.11) is feasible, but becomes infeasible at any r < ro- An easy modification 
of Example 2.2 can be used to exhibit such a situation. 

As lõng as one is not in the last situation described in the example, it 
follows from (2.13) that 

lim -^log ^K lt K 2 (u;r) = -^D Kl K2 (r). 

u —>OO z 

In this connection there is a very natural interpretation of the structure of 
the representation (2.14) of Dx t ,k 2 (r). Notice that 

lim —^ log P ( X (t) > u for all t E K\) 

u —^oo u z 

= \ min / / i?x(ti,t 2 )/ri(dti)/ri(dt 2 ) 

2 [^iGM+iAi) J Kt J Kt 

This can be read off part (b) in Theorem 2.3, and it is also a simple ex- 
tension of the results in Adler et ai. (2014). Therefore, we can interpret the 
situation in which the first minimum in the right händ side of (2.14) is the 
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smaller of the two minima, as implying that the order of magnitude of the 
probability ^k 1 ,k 2 ( u 'i r ) is determined, at least at the logarithmic level, by 
the requirement that X (t) > u for all t £ I\\. In this case, the requirement 
that X(t) < ru for all t £ K 2 does not change the logarithmic behaviour of 
the probability. This is not be entirely unexpected since the normal random 
variables in the set K2 “prefer” not to take very large values. 

On the other händ, if the correlations between the variables of the random 
field in the set K\ and those in the set K2 are sufficiently strong, it may 
happen that, once it is true that X (t) > u for each t £ K 1 , the correlations 
will make it unlikely that we also have X(t) < ru for all t £ K 2 . In that 
case the second minimum in the right händ side of (2.14) will be the smaller 
of the two minima. 

The discussion in Example 2.5 also leads to the following conclusion of 
Theorem 2.1. 

COROLLARY 2.6. Under the conditions of Theorem 2.1, suppose that 
there is (K[ r \ K^) £ C such that 

D c (r) = D K (r) K (r)(r) < 00 , 

and such that the optimization problem (2.11) for the pair (K^\ K^) re- 
mains feasible in a neighborhood ofr. Then 

(2.25) lim \ logT c (rt;r) = —^£> c (r). 

u —^00 Z 

PROOF. It follows from Theorem 2.1 that we only need to show that 

(2.26) lim Dq (r) = D c {r). 

rtr 

However, by the assumption of feasibility, as r f r, 

D c(r) < D K tr )iK (r) iT) ->• D K[r) K ^(r) = D c (r), 

giving us the only non-trivial part of (2.26). □ 

It turns out that under certain assumptions, given that the event in (1.4) 
occurs, the random field tt -1 X converges in law, asw-> 00, to a deterministic 
function on T, “the most likely shape of the field”. This is described in the 
following result. 



14 


ADLER AND SAMORODNITSKY 


Theorem 2.7. Under the conditions of Theorem 2.1, suppose that there 

Ar) 

is a unique (K ) ) E C such that 


(2.27) 


Dc(r) = D K (r) K (r){r) < oo , 


and such that the optimization problem (2.11) for the pair (K^\ K^) re- 
mains feasible in a neighborhood of r. Then for any e > 0, 


(2.28) P (: 


sup 
Vt eT 


-X(t) - x c { t) 

u 


> £ 


there is (Äi,iV 2 ) E C such that 


X(t) > u for each t E K\ and X(t) < ru for each t E iV 2 J — > 0 
as u —>• 00 . Here 

xc{ t) = E (X(t )H(K{ r \KP)') , t ET, 

andi7(ivi r) ,iV^ } ) is f/ie unique minimizer in the optimization problem (2.11) 
for the pair (K[ r \ K^). 

Proof. Using Theorem 3.4.5 in Deuschel and Stroock (1989), we see that 


hm sup —log P I sup 

u —>00 U VtST 


-X(t) - X C (t) 
u 


> £ 


and there is (K\ , K 2 ) E C 


such that X(t) > u for each t E K\ and X(t) < ru for each t E /\ 2 J 

< -\ D c{pe), 

where 

(2.29) Dc (r; e) = inf j EH 2 : H E £, sup |£7(X(t)fT) - x c (t)\ > e 

l teT 

and for some (K\ , iV 2 ) E C, 

> 1 for each t E K\ and E(X(t)H^ < r for each t E 17 2 j>. 

Therefore, the claim of the theorem will follow once we prove that Dc(r; e) > 
Dc(r). Indeed, suppose that the two minimal values coincide. Let H e be an 
optimal solution for the problem (2.29). Since H (K^, K^) is not feasible 
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for the latter problem, we know that H(k['\ K^) 7 ^ H e , while the two 
elements have equal norms. Since H £ is feasible for the problem (2.8), because 
of the assumed uniqueness of the pair (K^\ K^) in (2.27), it must also be 
feasible for the problem ( 2 . 11 ) with this pair (k['\ K^), hence optimal for 
that problem. This, however, contradicts the uniqueness property in part (a) 
of Theorem 2.3. □ 


3. Optimal measures. Theorem 2.3 together with (2.12) provide a 
way to understand the asymptotic behaviour of the probability in (2.7). The 
problem of hnding the two minima in the right händ side of (2.14) is not 
always simple since it is often unclear how to hnd the optimal probability 
measure(s) in these optimization problems. In this section we provide some 
results that are helpful for this task. 

We start with the first minimization problem on the right händ side of 
(2.14). In this case we can provide necessary and sufficient condition for a 
probability measure to be optimal. 

Theorem 3.1. A probability measure /i £ Mj + (K \) is optimal in the 
minimization problem 


mm / / 

AteM+(Ki) J Ii! J K! 


Äx(ti, t 2 ) ju(dti)/x(dt 2 ) 


if and only if 




#x(ti, t 2 ) n(dti)n(dt 2 ) 


min / 7?x(ti, t 2 ) n(dt\). 

t2SÄl J K 1 


This theorem can be proved in the same manner as part (ii) of Theorem 
4.3 in Adler et ai. (2014), so we do not repeat the argument. 

Next, observe that if the constraint (2.15) in the second minimization 
problem in (2.14) holds with equality, then 




Äx(ti,t 2 ) pi(dti)m(dt- 2 ) 


Bk,,k 2 (pu h' 2 ] r) ’ 


so it is of particular interest to consider optimality of p\ £ M+ (K\) and ^ 2 £ 
M+ (K 2 ) f° r the second minimization problem in (2.14) when the inequality 
in (2.15) is strict. It turns out that we can shed some light on this question in 
an important special case, when one of the sets K\ or K 2 is a singleton. For 
the purpose of this discussion we will assume that the set K 2 is a singleton. 
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Let, therefore, K 2 = {t>}, for some b E W d such that Var(X(b)) > 0. In 
that case the second optimization problem in (2.14) turns out to be of the 
form 


(3.30) 


subject to 


fiü Ik 1 R( x (*1^2) n(dt 1 )n(dt 2 ) 
min —---- 

MS M+(K X ) f Ki f Ki R<£\ t!,t 2 ) n{dt 1 )fl(dt 2 ) 


(3.31) 

where 


/ Ki 


^x(t, b) n(dt) > r / Rx(ti,t 2 ) fi{dt 1 )n(dt 2 ) 


IK 1 


= Äx(ti, t 2 )i?x(b, b) - i?x(ti, b)i?x(t 2 , b) 


and 


1 ^ 2 ) = ?’ 2 -Rx(ti,t 2 ) - r(i? x (ti,b) + Rx{ t 2 ,b)) + i?x(b,b). 

Notice that both Ry) and Ry are nonnegative definite, i.e. legitimate co- 
variance functions on T. In fact, up to the positive factor i?x(b,b), the 
function Ry is the conditional covariance function of the random held X 
given X(b), while Ry is the covariance function of the random held 


y(t) = rX( t) - X(b), t E T. 


This problem is a generalization of the hrst optimization problem in (2.14), 
with the optimization of a single integral of a covariance function replaced 
by the optimization of a ratio of the integrals of two covariance functions. 

The following result presents necessary conditions for optimality in the 
optimization problem (3.30) of a measure for which the constraint (3.31) is 
satished as a strict inequality. Note that the validity of the theorem does 
not depend on particular forms for Ry and Ry ■ Observe that the nonneg¬ 
ative dehniteness of Ry and Ry means that both the numerator and the 
denominator in (3.30) are nonnegative. If the denominator vanishes at an 
optimal measure, then the numerator must vanish as well (and the ratio is 
then deternrined via a limiting procedure). In the theorem we assume that 
the denominator does not vanish. 


Theorem 3.2. Let p, E M^(K\) be such that (3.31) holds as a strict 
inequality. Let p be optimal in the optimization problem (3.30) and 




Ry (ti,t 2 ) p(dti)p(dt 2 ) >0. 
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Then 

(3.32) f R^\ti,t) fj,(dti) f f {ti,t- 2 ) n{dt 1 )n(dt 2 ) 

J Ki J Ki J K-i 


> [ iž^ ) (ti,t)/x(dti) f f (ti, t2) n{dt\)ii(dt 2 ) 

J Ki J I<i J I<i 

for every t G K\. Moreover, (3.32) holds as as equality /a-almost everywhere. 


Proof. Let 

^ ^ _ Jki Iki ^x ' 1 ( t i? t 2) f/(dti)r/(dt 2 ) 

Iki Ski R x( t ^ t 2 ) v(. dt i)v{dt 2 ) 


for those ij G M(K\), the space of finite signed measures on K\ for which the 
denominator does not vanish. It is elementary to check that ih is Frechet dif- 
ferentiable at every such point, in particular at the optimal fi in the theorem. 
Its Frechet derivative at jj, is given by 


D^(n)[rj\ 


2 

(Ik i Ski ^ 5 ?(*1^2) Ai(rfti)/i(dt 2 )) 


I Ki J Ki 


ižx^(ti,t 2 ) n(dti)/j,(dt 2 


I Kl J Kl 


■^x^(ti) t 2 ) n{dti)rj(dt 2 


IK 1 J Kl 


R^\ti,t 2 )/j,(dti)n(dt 2 ) f [ R^\ti,t 2 ) fj J (dt 1 )?j(dt 

J Kl J Kl 


for i] G We view the problem (3.30) as the minimization problem 

(2.1) in Molchanov and Zuyev (2004). In our case the set A coincides with 
the cone M+ (K \) of probability measures, the set C is the negative half-line 
(—oo,0], and H : —> M is given by 


H(rj) =r f f iž x (ti,t 2 ) i){dt 1 )ij(dt 2 ) 
J Ki J Ki 



Rx(t, b) rj(dt ). 


This function is also easily seen to be Frechet differentiable at /i, and 


DH(n)[rj] = 2r f [ Ä x (ti, t 2 ) n(dti)rj(dt 2 ) - [ i? x (t, b) r](dt) 

J Ki J Ki J I<i 

for r/ G M(K\). Finally, the fact that (3.31) holds as a strict inequality 
implies that the measure /i is regular according to Dehnition 2.1 in Molchanov 
and Zuyev (2004). 

The claim (3.32) now follows from Theorem 3.1 in Molchanov and Zuyev 
(2004). □ 
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( 2 ) 

If, for example, the covariance function Ryf is strictly positive on K\, 
then an alternative way of writing the conclusion of Theorem 3.2 is 

Jk 1 (^i> > f Kl /^i (^i> ^ 2 ) A t (dti)//(dt2) 

/a'i ^(tDt)//^) J Ki üy(ti,t 2 )/x(rfti)M(dt 2 ) 

for every t £ Ah, with equality for /r-almost every t. This is a condition 
of the same nature as the condition in Theorem 3.1. The convexity of the 
double integral as a function of the measure ji in the optimization problem 
in Theorem 3.1 makes the necessary condition for optimality also sufficient. 
This convexity is lost in Theorem 3.2, and it is not clear at the moment when 
the necessary condition in that theorem is also sufficient. 

We conclude this section with an explicit computation of the limiting 
shape xc in Theorem 2.7 in terms of the optimal measures in the dual prob- 

( r ) (r)\ 

lem. We restrict ourselves to the case where the optimal pair (K\ ', Ah, ) is 

r r \ 

such that Ah; ' is a singleton. This would always be the case, of course, if we 
considered a family C consisting of a single pair of sets, (Ah, A' 2 ), with A' 2 a 
singleton, to start with. 

Theorem 3.3. Under the conditions of Theorem 2.7, assume that the 
set = {b} is a singleton. Let pL^ E be the optimal measure in 

the optimization problem (2.14) for the pair (A'j r \ K^). Then 

(3.33) x c (t) = D c (r) [ i? x (t, ti) // r) (dti), t E T, 

J Ki 

if the first minimum in (2.14) does not exceed the second minimum, and 

(3.34) xc{t) = a(/U M ) [ A x (t,ti)// r) (dti) - 6(/r (r) )A x (t,b) ,t£T, 

.J K\ 

if the first minimum in (2.14) is larger than the second minimum. Here 

(3.35) a(^ (r) ) = 

#x( b,b) -r f Ki i? x (ti,b)//W(dti) 
b,b) f Ki f Ki A x (ti, t 2 ) p,( r l(dt 1 )fj,( r l(dt 2 ) - (f Ki A x (ti,b)/xW(dti)) 

and 

Ka w ) = 

r Lü Ik ! - f Ki A x (ti, b) n^ r \dti) 

r f Kl A x (ti,b)/x( r )(dti) - A x (b,b) 


(3.36) 
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Remark 3.4. Notice that, since the set K 2 = {t>} is a singleton, only a 
measure in Mj + (K\) is a variable over which one can optimize, as (K 2 ) 
consists of a single measure, the point mass at b. Notice also that we are 
using the same name, 4 r \ for the optimal measure throughout Theorem 3.3 
for notational convenience only, because in the two different cases considered 
in the theorem, it referes to optimal Solutions to two different problems. 

Proof of Theorem 3.3. By Theorem 2.7 all we need to do is to prove 
the following representations of the unique minimizer HK^) in the 

optimization problem (2.11) for the pair ). If the first minimum 

in (2.14) does not exceed the second minimum, then 

(3.37) H{l4\K^) =D c (r) [ X(tr) ^(dt,) , 

and, if the first minimum in (2.14) is larger than the second minimum, then 

(3.38) H(K[ r) ,K^ r) ) = a(4 r) ) [ X(ti) ^(dt^ - b(n^)X(b) 

YJ Kl 

We start by observing that, under the assumptions of Theorem 2.7, the 
feasible set in the optimization problem (2.11) for the pair (K[ r \ K has an 
interior point. Therefore, Theorem 1 (p. 224) in Luenberger (1969) applies. It 
follows that the vector H(k['\ K solves the inner minimization problem 
in (2.17) when we use 

Hi = mnj( r \ H2 = m 2 6 h , 

where mi and m 2 are nonnegative numbers solving the optimization problem 
(2.20) corresponding to the measures /. 1 ^ and d)-,. It follows immediately that 
H (K[ r \ K^) must be of the form 

(3.39) H(K[ r) ,l4 r) ) = a mi [ X(tr) ^(dti) - m 2 X(h) 

l J Ki 

for some a > 0. 

We now consider separately the two cases of the theorem. Suppose first 
that the first minimum in (2.14) does not exceed the second minimum. In 
that case we have m 2 = 0 above, see Remark 2.4. According to that remark, 
this happens when 

(3.40) f Rx(ti,b) 4 r \dti) < r [ f R x (ti, t 2 )/i (r) (dti)/i (r) (dt 2 ). 

J K, J Ki J Ki 
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We combine, in this case, a and mi in (3.39) into a single nonnegative con- 
stant, which we stiil denote by a. We then consider vectors of the form 

(3.41) H(K[ r \K^ r) ) = a [ X(ti) /x {r) (dti) 

J K\ 

as candidates for the optimal solution in (2.11). The statement (3.37) will 
follow once we show that a = Dc{r ) is the optimal value of a. By Theorem 
2.3, we need to show that the optimal value of a is 

(3.42) a =([ [ #x(ti,t 2 ) ^ r \dti)^ r \dt 2 ), 

Ki J K i 

The first step is to check that using a given by (3.42) in (3.41) leads to a 
feasible solution to the problem (2.11). Indeed, the fact that the constraints 
of the type “>” in that problem are satisfied follows from the optimality 
of the measure / x^ and Theorem 3.1. The fact that the constraint of the 
type “<” in that problem is satisfied follows from (3.40). This establishes the 
feasibility of the solution. Its optimality now follows from the fact that using 
a given by (3.42) in (3.41) leads to a feasible solution whose second moment 
is equal to the optimal value Dc(r). 

Suppose now that the first minimum in (2.14) is larger than the second 
minimum. According to Remark 2.4 this happens when (3.40) fails and, 
further, we have 



where is defined in (3.36). Combining, once again, a and mi in (3.39) 

into a single nonnegative constant, which is stiil denoted by a, we consider 
vectors of the form 

(3.43) H(K[ r \hi r) ) = a [ X(ti) ^ r \dti) - 6(/x (r) ) A(b) 

Uiü 

as candidates for the optimal solution in (2.11). The proof will be complete 
once we show that the value of a = a(/i^) given in (3.35) is the optimal 
value of a. 

Notice that for vectors of the form (3.43), the optimal value of a solves 
the optimization problem 

min a 

a> o 



(3.44) 


subject to 
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a 



-Rx(t,ti)// r) (dti) - 6(/x (r) )iž x (t,b) 


> 1 


for each t E K\ , 


a 



i?. x (b,ti) n (r \dti) - 6(/i (r) )iž x ( b,b) 


< r. 


The first step is to check that the value of a = given in (3.35) is 

feasible for the problem (3.44). First of all, nonnegativity of this value of 
o follows from the fact that (3.40) fails. Furthermore, it takes only simple 
algebra to check that the “<” constraint is satished as an equality. In order to 
see that the “>” constraints are satished as well, notice that, since (3.40) fails, 
we are in the situation of Theorem 3.2. Therefore, the measure /i(' r ) satishes 
the necessary conditions for optimality given in (3.32). Again, it takes only 
elementary algebraic calculations to see that these optimality conditions are 
equivalent to the “>” constraints in the problem (3.44). 

Now that the feasibility has been established, the optimality of the solution 
to the problem (2.11) given by using in (3.43) the value of a = a(p^) 
from (3.35), follows, once again, from the fact that this feasible solution has 
second moment equal to the optimal value Dc(r). as can be checked by easy 
algebra. □ 


4. Isotropic random fields. In this section we will consider stationary 
isotropic Gaussian random fields, i.e. random fields for which 

-Rx(ti,t 2 ) = iž(||ti - t 2 ||), tl, t 2 G T , 

for some function R on [0, oo). We will concentrate on the asymptotic be- 
haviour of the probabilities 'F sp ('u;r) and \k sp;c (u;r) in (1.2) and (1.3) corre- 
spondingly. 

We consider the probability 4 / sp;c (u; r) first. In this case, by (2.12) and 
isotropy, 

(4.45) Dc(r) = min ^M p (r), 
where 

(4.46) D = supjp > 0 : there is a ball of radius p entirely in T} , 

and M p (r ) = Dx 1 ^K 2 ( r ) br (2-11) with K± being the sphere of radius p cen- 
tered at the origin, and /l 2 = {0}. The following result provides a fairly de- 
tailed description of the asymptotic behaviour of the probability T sp;c (u; r). 
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Theorem 4.1. Let X be isotropic. Then 
(4.47) lim 4log^ c («;r) = -- min M p (r). 

u-+oo U 2 2 0 <P<D ^ 


Furthermore, for every 0 < r < 1, M p (r ) = (Wp(r)) 


-i 


where 


(4.48) W p (r) 


Ö(P) 

R(0)D(p)-(r(p)) 2 

R(0)—2rR(p)+r 2 D(p) 


ifR(p) < rD(p ), 
if R(p) > rD{p ). 


Here 

(4.49) D(p) = I [ R(\\ti-t 2 \\)p h (dti)p h (dt 2 ), 

Js p ( o) Js p ( o) 

where S^O) is the sphere of radius p centered at the origin, and p,h is the 
rotation invariant probability measure on that sphere. 


Proof. We use part (b) of Theorem 2.3 with K\ = S p (0) and iY) = {0}. 
Note first of all that by the rotation invariance of the measure ph, the function 

f .R(||ti — t 2 ||) ph(dti), t 2 € S p (0), 

J K i 

is constant. Hence by Theorem 3.1 the measure /_//, is optimal in the first 
minimization problem on the right händ side of (2.14), and the optimal 
value in that problem is D(p). 

In the second minimization problem on the right händ side of (2.14), since 
K -2 is a singleton, the optimization is only over measures p\ € (K\). and 

so we drop the unnecessary p 2 in the argument in the ratio in that problem. 
By the isotropy of the field, 

A Ki ,k 2 {pi) _ Jki fK i ~ t 2 Ü ) ^i(<žti)//i(dt 2 )iž(0) - (R{p)) 2 
B Klt K 2 (pr )r ) r 2 f Ki f Ki i?(||t! - t 2 1|)/xi(dti)/xi(ežt 2 ) - 2rR(p) + R(0) 

_ R( 0) _ (JM ~ R(0)/r) 2 _ 

r 2 r' 2 f Ki f Ki Ä(||ti - t 2 ||) pi(dt 1 )p 1 (dt 2 ) - 2rR(p) + R( 0) ' 

Since the expression in the denominator is nonnegative (see the discussion 
following (3.31)), the ratio in the left händ side is smaller if the double 
integral in the right händ side is smaller. Furthermore, condition (2.15) reads, 
in this case, as 

R(0) > r f f R(\\ti-t 2 \\) pi(dti)pi(dt 2 ) . 

■I K\ J Kt 
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This means that, if this condition is satisfied when the double integral is 
large, it is also satisfied when the double integral is small. Recalling that the 
double integral is smallest when /r = /i/,, we conclude that 

if R(p) < rD(p), 
if R(p) > rD(p). 


min 

ii | eiwt (Ki) 


Ari,K2 (a*i 


oo 


B T<-, 


( II- 


r{0)D{p)-(r(p)) 2 
R(0) — 2rR(p)+r 2 D(p) 


Finally, since 


(4.50) 


R(0)D(p) - {Rjpjf 
R(0) — 2rR(p) + r 2 D(p) 


= D(p) 


trD(p) - R(p)) 2 
R( 0) — 2 rR(p) + r 2 D(p) 


< D{p ), 


we obtain (4.48). 

It remains to prove (4.47). We use (4.45). By Theorem 2.1, it is enough to 
prove that the function Dq is left continuous. By monotonicity, if Dq = oo 
for some r > 0, then the same is true for all smaller values of the argument, 
and the left continuity is trivial. Let, therefore, 0 < r < 1 be such that 
Dq < oo. Let 0 < po < D be such that 


M on (r) = min MJr). 

o <p<d H 

Then W Po (r) > 0. By (4.48), the W p (r) is, for a fixed p, a continuous function 
of r. Therefore, 

lim D c (s) < lim(Wp(s)) -1 = {W^r)) 1 = D c {r). 

•st» - str 

By the monotonicity of the function Dc, this implies left continuity. □ 


The distinction between the situations described by the two conditions on 
the right händ side of (4.48) can be described using the intuition introduced 
in the discussion following Example 2.5. If there is a “peak” of height greater 
than u covering the entire sphere of radius p, is it likely that there will 
be a “hoie” in the center of the sphere where the height is smaller than 
ru! Theorem 4.1 says that a hoie is likely if R{p) < rD(p) and unlikely if 
R(p) > rD(p), at least at the logarithmic level. 

It is reasonable to expect that, for spheres of a very small radius, a hoie in 
the center is unlikely, while for spheres of a very large radius, a hoie in the 
center is likely, at least if the terms “very small” and “very large” are used 
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relatively to the depth of the hoie described by the factor r. This intuition 
turns out to be correct in many, but not all, cases, and some unexpected 
phenomena emerge. We will try to clarify the situation in the subsequent 
discussion. 

We look at spheres of very small radius first. Observe hrst that by the 
continuity of the covariance function, we have both R(p) — > R(0) and D(p ) -A 
R( 0) as p —> 0. Therefore, if 0 < p < 1, then the condition R(p) > rD(p) 
holds for spheres of sufficiently small radii, and a hoie that deep is, indeed, 
unlikely. Is the same true for r = 1? In other words, is it true that there is 
5 > 0 such that 

(4.51) D(p) < R(p) for all 0 < p < 5? 

A sufficient condition is that the function R is concave on [0,2c)]; this is 
always the case for a sufficiently small õ > 0 if the covariance function R 
corresponds to a spectral measure with a hnite second moment. To see how 
the concavity implies (4.51), note that by the Jensen inequality, 


D(p) < R 



Sp( 0) 


Itl - t 2 \\ph(dt 1 ) p h (dt 2 ) 


Further, by the symmetry of the measure ph and the triangle inequality, 




tl - t 2 || Ph(dti) Ph{dt 2 ) 



t 2 H/2 + ||ti + t 2 H/2) ph{dt\) p h (dt 2 ) 


> 




ti\\ p h (dti) p h (dt 2 ) = 6. 


Since the concavity of R on [0, 25} implies its monotonicity, we obtain (4.51). 

In dimensions d > 2, the hoie in the center with r = 1 may be unlikely for 
small spheres even without concavity. Consider covariance functions satisfy- 
ing 


(4.52) R(p) = R( 0) - apP + o(pP) , as p —> 0, 


for some a > 0 and 1 < (3 < 2. To see that this implies (4.51) as well, notice 
that, under (4.52), 

D(p) = R(0)-apd [ f \\t 1 -t 2 W 13 p h {dti) p h (dt 2 )+o(pP), as p -A 0. 
JSi(O) Jspo) 
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Using, as above, the symmetry together with the Jensen inequality and the 
triangle inequality we see that 




ti - t 2 \f p h (dti) fJ, h (dt 2 ) 


> 



t 2 || /3 /2+ ||ti +t 2 |[ / V 2 ) Vhidti) fj, h (dt 2 ) 

t 2 1|/2 + ||ti + t 2 11 /2) 3 n h (dt\) Hh(dt 2 ) 


> [ [ \\ti\\P Hh(dti) fj, h (dt 2 ) = 1 ■ 

Js i(0) JSi(O) 

Thus we see that for some ai > a, 


D(p ) = R( 0) — aip 13 + o(/9 /3 ), as p -> 0, 


and so (4.51) holds for 6 > 0 small enough. 

An example of the situation where (4.52) holds without concavity condi- 
tion is that of the isotropic Ornstein-Uhlenbeck random held corresponding 
to R(t) = exp{—a|t|} for some a > 0. It is interesting that for this random 
held a hoie in the center with r = 1 is unlikely for small spheres in dimension 
d > 2, but not in dimension d = 1. Indeed, in the latter case we have 

D(p) = (1 + e~ 2ap )/2 > e~ ap = R{p ), 


no matter how small p > 0 is. 

When p —> oo, we expect that a hoie in the center of a sphere will become 
likely no matter what 0 < r < 1 is. According to the discussion above, this 
happens when 


(4.53) 


lim 2M 

P loo R(p) 


= oo. 


This turns out to be true under certain short memory assumptions. Assume, 
for example, that R is nonnegative and 


(4.54) 


liminf ^ ' ^ > t a with a > d — 1 , for all 0 < t < 1 . 
v loo R(V) 


Then by Fatou’s lemma, 


D(p) 


hm inf 
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> [ [ l(||ti-t 2 

Js i(0) JsR 0) 

> [ [ l(lltl-t 2 

Js 1(0) JSRO) 

so that (4.53) holds. 

However, in dimensions d > 2, the situation turns out to be different 
under an assumption of a longer memory. Assume, for simplicity, that R is 
monotone, and suppose that, for some e > 0, 

(4.55) R is regularly varying at inhnity with exponent — {d — 1) + £. 

We claim that, in this case 

(4.56) hm §4 = ( [ ||ti - t 2 \\~ ( ' d ~ 1 ' >+£ Hh(dti) ph{dt 2 ) < oo . 

°° R\P) JSi(o) JSi(q) 

It is easy to prove this using Breiman’s theorem as in, for instance, Propo- 
sition 7.5 in Resnick (2007). Let Z be a positive random variable such 
that P(Z > z) = R(z)/R{ 0), and let Y be an independent of Z positive 
random variable whose law is given by the image of the product measure 
Ph x Uh on Si(0) x Si(0) under the map (ti,t 2 ) i->- 111 1 — 1 2 || _1 . Notice that 
EY d ~ i -e /2 < oo. Therefore, by Breiman’s theorem, as p —> oo, 

D(p) = R(0)P(ZY > p)~ R(0)EY d - l ~ e P{Z > p) 

= R(p) [ f ||ti -t 2 |r (d_1)+£ Ph(dti) p h (dt 2 ) ■ 

J Si(0) J 5i(0) 

If we call 

I(d;e)= [ f ||ti - t 2 \\- {d - 1)+£ Ph{dti) p h (dt 2 ), 

Js i(0) J Si(0) 

then we have just proved that the hoie in the center of a sphere corresponding 
to a factor r < 1 /I(d\e) remains unlikely even for spheres of inhnite radius! 
This is in spite of the fact, that the random field is ergodic, and even rnixing, 
as the covariance function vanishes at inhnity. This phenomenon is impossible 
if d = 1 since in this case D{p) does not converge to zero as p —> oo. 

Some estimates of the integral /(c?;e) for d = 2 and d = 3 are presented 
on Fig. 4.1. 

One can pursue the analysis of holes in the center of a sphere a bit further, 
and talk about the most likely radius of a sphere for which the random held 


< 1) liminf —- 1 2 P p, h {dti) p h (dt 2 ) 

p->oo R\P) 

< 1) ||ti - t 2 || _a Ph(dti) p h (dt 2 ) = oo , 



CLIMBING DOWN GAUSSIAN PEAKS 


27 



Fig 4.1: The integral I(d;e) for d = 2 and d = 3 


has a “peak” of height greater than u covering the entire sphere, and a “hoie” 
in the center of the sphere where the height is smaller than ru, as u —> oo. Ac- 
cording to Theorem 4.1, this most likely radius is given by argmax p> glFp(r). 
The following corollary shows how calculate this most likely radius. For sim- 
plicity, we assume that R is monotone and 0 < r < 1. Let 


_ R(0)D(p) - ( R{p)) 

(l> R(0)-2rR(p) + r 2 D(pY P 


COROLLARY 4.2. Assume that R is monotone with R(t) —>■ 0 as t —> oo, 
and 0 < r < 1. Let 

Pr = argrna x p > 0 F p (r). 

Then p* is the most likely radius of the sphere to haue a hoie corresponding 
to a factor r in the center. 


PROOF. Since 

hm H p (r ) = hm H p (r ) = 0 , 

p—0 p—»oo 

it follows that p* 6 (0, oo). Write 

p r = inf{ p > 0 : R(p) < rD(p)} . 

Since 0 < r < 1, it follows that õ r 6 (0, oo]. Observe that for 0 < p < p*, by 
the monotonicity of D and (4.50), 

(4.57) D(p) > D(p*) > H p *(r ) > H p (r ). 

This implies that p* < p r . Indeed, if this were not the case, there would be 
0 < p < p*. for which R(p) = rD(p), and this, together with (4.50), would 
imply that D{p) = H p (r ), contradicting (4.57). 
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By Theorem 4.1 we conclude that W p * (r) = H p * (r), so it remains to prove 
that W p (r) < H p * (r) for all p ^ p*. 

However, if 0 < p < p r , then 

W p (r) = H p (r) < H p .(r) 

by the definition of p*. On the other händ, if p > p r , then by the monotonicity 
of D, 

W p (r) < D(p) < D(p r ) = H pr (r) < H p *(r ), 
and so the proof is complete. □ 

For the covariance function R(t) = e~ t2 the two plots of Fig. 4.2 show the 
plot of the functions D and H( 1/2), as well as the optimal radius p* as a 
function of r. 



Fig 4.2: The functions D{p) (solid line) and H p (r ) (dashed line) for r = 1/2 
(left plot) and the optimal radius p* (right plot), both for R(t) = 

For the same covariance function R{t) = e~ tr and r = 1/2 the plots of 
Fig. 4.3 show the limiting shapes of the random held described in Theorem 
3.3. The left plot corresponds to the sphere of radius p = 1 (falling in the 
second case of the theorem), while the right plot correspond to the sphere 
of radius p = 2 (falling in the first case of the theorem). Note that, by the 
isometry of the random field, the limiting shape is rotationally invariant. The 
plots, therefore, present a section of the limiting shape along the half-axis 
t\ > 0, £2 = 0. For ease of comparison, the horizontal axis has been labeled 
in the units of ti/p, i.e. relative to the radius of the sphere. 

We hnish this section by considering the probability 4/ sp (u;r) in (1.2). In 
this case, by (2.12) and isotropy, 

(4.58) Dr(r) = min min M a {r\b ), 

v ’ 0<6<10<P<D PK ’ 
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Fig 4.3: The limiting shapes for p = 1 (left plot) and p = 2 (right plot), both 
for r = 1/2 and R(t) = e~ t2 


where D is as in (4.46), and M p (r\b ) = Dx x .k 2 (r) in (2.11) with K\ being 
the sphere of radius p centered at the origin, and K 2 = {&ei}. Here ei is the 
ri-diinensional vector (1,0, ...,0). It turns out that in many circumstances 
the asymptotic behavior of the probabilities '3 / sp;c (n;r) and \E , sp (u;r) is the 
same, at least on the logarithmic case, and so our analysis of the former 
probability applies to the latter probability as well. 

The following result demonstrates one case when the two probabilities are 
asymptotically equivalent. Assurne for notational simplicity that R( 0) = 1, 
and use the notation S± in place of Si(0). For p>0, 0<6<1 and 
p G M/~(Si), let 

(4.59) V(p,b-p) = 

f Sl fs x “ t 2II ) p(dt 1 )p(dt 2 ) - (f Si R(p\\t - 6ei||) /x(dt)) 

1 “ 2r /si - be^l) p(dt) + r 2 J Si f Si R(p\\ti - t 2 ||) p{dt 1 )p{dt 2 )' 

Theorem 4.3. Let 


V*(p,b)= min V(p,b-p) 
neM+{Si) 


subject to 


(4.60) 


( R{p\\t - be 1 \\)p(dt) > r f f R(p\\ti -1 2 \\) p(dt 1 )p(dt 2 ) 
8 1 Js 1 JS 1 
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If, for every 0 < p < D such that R(p ) > rD(p), the function V*(p,b ), 0 < 
b < 1 achieves its maximum at b = 0, then 

(4.61) lim \ log\E r sp ('ii;r) = min (W p (r)) ' , 

m-s-oo u 2 2o <p<D y F ' 

where W p (r) is defined by (4.48). 

PROOF. It follows from (4.58), (4.45) and Theorem 2.3 that we only need 
to check that M p (r ) = info<b<i M p (r\b) for all 0 < p < D. Notice that by 

(3.30) , (3.31) and isotropy, 

M p (r\b) = (min (D(p),V*{p,b))) 1 , 

where D(p) is given in (4.49). Further, M p (r) = M p (r\ 0). If R(p) < rD(p), 
then 14(p, 0) = oo, so there nothing to check. If, on the other händ, R(p) > 
rD(p), then V*(p, •) achieves its maximum at the origin, so the claim of the 
theorem follows. □ 

The condition 

(4.62) I4(p,0) = max V*(p,b ), 

0<fc<l 

for 0 < p < D such that R(p) > rD(p), deserves a discussion. We claim that 
this condition is implied by the following, simpler, condition. 

(4.63) min/ R(p\\t - bei ||) p h {dt) = [ R(p\\t\\) p h (dt) = R{p), 

0<b<iJs 1 JS! 

where ///, is the rotation invariant probability measure on S i. 

To see this let R(p) > rD{p). It follows by (4.63) that the constraint 

(3.31) is satished for the measure /j/, and the vector 6ei for any 0 < b < 1. 
Therefore, 


where 


V* (p, b) <V(p, 6; p h ) = G [ / R{p\\t - 6ei||) p h {dt) 


'Si 


G{x) 


D{p) — x 2 
1 — 2 rx + r 2 D{p) ’ 


R{p) < x < 1. 


= ~2{x - rD(p))(l - rx) 
(l — 2 rx + r 2 D(p)) 2 


Notice that 
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so that the function G achieves its maximum at x = R{p)- We conclude that 


V*(P, b) < V (, p , 0; p h ) = K (p, 0), 


so that (4.62) holds. 

Numerical experiments indicate that the condition (4.63) tends to hoid for 
values of the radius p exceeding a certain positive threshold. For instance, 
in dimension d = 2 for both R(t) = e _t and R(t) = e 1*1, this threshold is 
around p = 1.18. 

However, it is clear that condition (4.63) is not necessary for condition 
(4.62). In fact, for condition (4.62) to be satished one only needs a measure 
p G M± (Si) satisfying (4.60) such that 

(4.64) V(p,b-p)<V(p,0;p h ), 

and what condition (4.63) guarantees is that this measure can be taken to 
be the rotationally invariant measure on S \. If (4.63) fails, then there is no 
guarantee that the rotationally invariant measure will play the required roie. 

At least in the case when the covariance function R is monotone, one can 
consider a measure p that puts a point mass at the point on the sphere 
closest to the point be i. We have considered measures p G M( t "(S’i) of the 
form 

(4.65) p = rc<5 sign ( fe ) ei + (1 - w)p h 

for some 0 < w < 1, where S a is, as usual, the Dirac point mass at a 
point a. With this choice, the function V in (4.59) becomes the ratio of two 
quadratic functions of w, and one can choose the value of w that minimizes 
the expression, because (4.64) requires us to search for as small V as possible. 

In our numerical experiments we have followed an even simpler procedure 
and chosen the value of w that minimizes the quadratic polynomial in the 
numerator of (4.59). For the cases of R(t) = e~ t and R(t) = e~^ the 
resulting measure p in (4.65) satished, for all 0 < p < D such that R(p) > 
rD(p), both (4.60) and (4.64). Therefore, in all of these cases the conclusion 
(4.61) of Theorem 4.3 holds. 

Acknowledgement We are indebted to Jim Renegar of Cornell Univer- 
sity for useful discussions of the duality gap in convex optimization and for 
drawing our attention to the paper Anderson (1983). 
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